Proceedings of the 18th International Conference on Multimedea 2010

Geometric tampering estimation by means of a SIFT%2Dbased forensic analysis.

Sensor Fusion for Cooperative Head Localization.

Person Detection Using Temporal and Geometric Context with a Pan Tilt Zoom Camera.

A Set of Selected SIFT Features for 3D Facial Expression Recognition.

Interactive Visual Representations of Complex Information Structures.

Video Annotation and Retrieval Using Ontologies and Rule Learning.

Exploiting distinctive visual landmark maps in pan%2Dtilt%2Dzoom camera networks.

Video Annotation and Retrieval Using Ontologies and Rule Learning.

Matching Trajectories between Video Sequences by Exploiting a Sparse Projective Invariant Representation.

Video event classification using string kernels.

Semantic annotation of soccer videos by visual instance clustering and spatial%2Ftemporal reasoning in ontologies.

Arneb a rich internet application for ground truth annotation of videos.

Sirio an ontology%2Dbased web search engine for videos.

Video Event Classification Using Bag of Words and String Kernels.

Recognizing human actions by fusing spatio%2Dtemporal appearance and motion descriptors.

David Discriminant analysis for verification of monuments in image data.

Deep networks for audio event classification in soccer videos.

Natural Interaction.
Introduction  Natural interactivity refers to a vision of the future of interaction between humans and computer systems. The vision is technological in nature and states the goal to eventually produce systems with which users communicate in the same ways in which humans communicate with one another. This goal is evidently of a very long-term nature, so long-term, in fact, that it makes little practical sense to investigate the market opportunities it affords at the present time. However, it is an interesting property of the natural interactivity vision that we are intimately familiar with the ultimate goal it proposes, and that this goal generates a series of well-defined research challenges which must be met in order to reach that goal. By consequence, it is possible to operationalise the goal in terms of a &#034;first relay&#034; goalpost which must be passed on the way towards full natural interactivity. This goalpost is called domainoriented natural interactive communication below. Given tha
Dynamic Pictorially Enriched Ontologies for Digital Video Libraries.

3D Mesh decomposition using Reeb graphs.

Introduction to the special section for the best papers of ACM multimedia 2008.

Proceedings of the 1st ACM SIGMM International Conference on Multimedia Information Retrieval

Proceedings of the 16th International Conference on Multimedia 2008

Proceedings of the 1st ACM SIGMM International Conference on Multimedia Information Retrieval

Face Recognition by SVMs Classification and Manifold Learning of 2D and 3D Radial Geodesic. Distances.

Connecting artists and scientists in multimedia research.

Uncalibrated Framework for On%2Dline Camera Cooperation to Acquire Human Head Imagery in Wide Areas.

Evolving tuis with smart objects for multi%2Dcontext interaction.

3D face retrieval using integral geometric shape information.

Automatic trademark detection and recognition in sport videos.

Face recognition by SVMS classification of 2D and 3D Radial Geodesics.

Video Event Annotation using Ontologies with Temporal Reasoning.

SVMS Classification of 2D and 3D Radial Geodesic Distances for Face Recognition.

Automatic Detection of Advertising Trademarks.

Learning ontology rules for semantic video annotation.

SHREC%2708 entry 3D face recognition using integral shape information.

Learning Rules for Semantic Video Event Annotation.

Editorial Introduction to the Special Issue on Multimedia Data Mining.

Special issue on natural interaction.

Natural interaction on tabletops.
Storytelling is an essential activity in the life of children. By listening or sharing their stories and ideasthey give meaning to their world and practice their communication skill. Even though the compute were already present in the infantile world, there is to get between the software developed for theirs and the ones that really give voice for this little uses. This paper presents the Reactoon System: an authoring tool for building 2D animations for a tabletop with tangible user interface and multi-touch.
A real%2Dtime full body tracking and humanoid animation system.
 
Proceedings of the 9th ACM SIGMM International Workshop on Multimedia Information Retrieval

Introducing tangerine a tangible interactive natural environment.

Accurate self%2Dcalibration of two cameras by observations of a moving person on a ground plane.

Improving the robustness of particle filter%2Dbased visual trackers using online parameter adaptation.

Compact representation and probabilistic classification of human actions in videos.

Soccer players identification based on visual local features.



Description%2C Matching and Retrieval by Content of 3D Objects.

DelosDLMS %2D The Integrated DELOS Digital Library Management System.

Adaptive uncertainty estimation for particle filter%2Dbased trackers.

Robust Iris Localization and Tracking based on Constrained Visual Fitting.

Geodesic Distances for 3D%2D3D and 2D%2D3D Face Recognition.

Semantic annotation and retrieval of video events using multimedia ontologies.
Effective usage of multimedia digital libraries has to deal with the problem of building efficient content annotation and retrieval tools. In this paper Multimedia Ontologies, that include both linguistic and dynamic visual ontologies, are presented and their implementation for soccer video domain is shown. The structure of the proposed ontology itself, together with reasoning, can be used to perform higher-level annotation of the clips, to generate complex queries that comprise actions and their temporal evolutions and relations and to create extended text commentaries of video sequences. 1.
3D Face Recognition using iso%2DGeodesic Surfaces.

Multimedia Ontology Based Computational Framework for Video Annotation and Retrieval.

Face Recognition by Matching 2D and 3D Geodesic Distances.

Dynamic pictorial ontologies for video digital libraries annotation.
In this paper, we present the dynamic pictorial ontology paradigm for video annotation. Ontologies are often used to describe a given domain for different goals, including description of multimedia data. In the case of video annotation, the visual knowledge cannot be described using only abstract concepts but is more effectively represented in a visual form. To this aim, we introduce visual concepts, elicited from the data set as the most representative prototypes that specialize abstract concepts. The ontology created is intrinsically dynamic since it must embrace the perceptual and visual experience during annotation. Thus visual concepts can change, adapting to the multimedia content analyzed. Motivation for this new ontology paradigm are discussed together with a proposal of a framework for ontology creation, maintenance, and automatic annotation of video. The creation and usage of dynamic pictorial ontologies have been tested for soccer domain exploiting low level perceptual features and higher level domain features.
Trademark matching and retrieval in sports video databases.
In this paper we describe a system for detection and retrieval of trademarks appearing in sports videos. We propose a compact representation of trademarks and video frame content based on SIFT feature points. This representation can be used to robustly detect, localize, and retrieve trademarks as they appear in a variety of different sports video types. Classification of trademarks is performed by matching a set of SIFT feature descriptors for each trademark instance against the set of SIFT features detected in each frame of the video. Localization is performed through robust clustering of matched feature points in the video frame. Experimental results are provided, along with an analysis of the precision and recall. Results show that the our proposed technique is efficient and effectively detects and classifies trademarks.
Automatic Detection and Recognition of Players in Soccer Videos.
Abstract. An application for content-based annotation and retrieval of videos can be found in the sport domain, where videos are annotated in order to produce short summaries for news and sports programmes, edited reusing the video clips that show important highlights and the players involved in them. The problem of detecting and recognizing faces in broadcast videos is a widely studied topic. However, in the case of sports videos in general, and soccer videos in particular, the current techniques are not suitable for the task of face detection and recognition, due to the high variations in pose, illumination, scale and occlusion that may happen in an uncontrolled environment. In this paper we present a method for face detection and recognition, with associated metric, that copes with these problems. The face detection algorithm adds a filtering stage to the Viola and Jones Adaboost detector, while the recognition algorithm exploits i) local features to describe a face, without requiring a precise localization of the distinguishing
Content%2DBased Retrieval of 3%2DD Objects Using Spin Image Signatures.

Multimedia enriched ontologies for video digital libraries.

Robust tracking and remapping of eye appearance with passive computer vision.

Automatic detection of player%27s identity in soccer videos using faces and text cues.

Automatic annotation and semantic retrieval of video sequences using multimedia ontologies.

MOM multimedia ontology manager. A framework for automatic annotation and semantic retrieval of video sequences.

PEANO pictorial enriched annotation of video.

Learning Foveal Sensing Strategies in Unconstrained Surveillance Environments.

3D Face Recognition by Modeling the Arrangement of Concave and Convex Regions.

Video Clip Matching Using MPEG%2D7 Descriptors and Edit Distance.

Camera Calibration with Two Arbitrary Coaxial Circles.
Abstract. We present an approach for camera calibration from the image of at least two circles arranged in a coaxial way. Such a geometric configuration arises in static scenes of objects with rotational symmetry or in scenes including generic objects undergoing rotational motion around a fixed axis. The approach is based on the automatic localization of a surface of revolution (SOR) in the image, and its use as a calibration artifact. The SOR can either be a real object in a static scene, or a “virtual surface ” obtained by frame superposition in a rotational sequence. This provides a unified framework for calibration from single images of SORs or from turntable sequences. Both the internal and external calibration parameters (square pixels model) are obtained from two or more imaged cross sections of the SOR, whose apparent contour is also exploited to obtain a better calibration accuracy. Experimental results show that this calibration approach is accurate enough for several vision applications, encompassing 3D realistic model acquisition from single images, and desktop 3D object scanning. 1
Using Knowledge Representation Languages for Video Annotation and Retrieval.

Topological Active Nets for Object%2DBased Image Retrieval.

Bringing the Wiki Collaboration Model to the Tabletop World.

Matching Faces with Textual Cues in Soccer Videos.

3D Face Identification Based on Arrangement of Salient Wrinkles.

Modeling Spatial Relationships between 3D Objects.

Partitioning of 3D Meshes using Reeb Gra.



Multi%2DUser Natural Interaction System based on Real%2DTime Hand Tracking and Gesture Recognition.

Object%2DBased Image Retrieval Using Active Nets.

A Desktop 3D Scanner Exploiting Rotation and Visual Rectification of Laser Profiles.
Abstract. We describe a low cost system for metric 3D scanning from uncalibrated images based on rotational kinematic constraints. The system is composed by a turntable, an off-the-shelf camera and a laser stripe illuminator. System operation is based on the construction of the virtual image of a surface of revolution (SOR), from which two imaged SOR cross-sections are obtained in an automatic way, and internal camera calibration is performed by exploiting the same object being scanned. Shape acquisition is finally obtained by laser profile rectification and collation. Experiments with real data are shown, providing an insight into both camera calibration and shape reconstruction performance. System accuracy appears to be adequate for desktop applications. 1
Automatic Partitioning of 3D Meshes.

Video Annotation and Retrieval with Pictorially Enriched Ontologies.

Description and retrieval of 3D face models using iso%2Dgeodesic stripes.

Diversity in multimedia information retrieval research.
Multimedia information retrieval is a highly diverse field. A variety of data types, research problems, methodologies are involved. Researchers in the field come from very different disciplines, ranging from mathematical and physical sciences, computational sciences and engineering, to application domains. The panel, consisting of highly visible active researchers from both academia and the industry, opens a discussion on the importance of diversity to the healthy growth of the field. This paper records their opinions expressed at the panel.
Video Automatic Annotation.
Conventional approaches to video annotation predominantly focus on supervised identification of a limited set of concepts, while unsupervised annotation with infinite vocabulary remains unexplored. This work aims to exploit the overlap in content of news video to automatically annotate by mining similar videos that reinforce, filter, and improve the original annotations. The algorithm employs a two-step process of search followed by mining. Given a query video consisting of visual content and speech-recognized transcripts, similar videos are first ranked in a multimodal search. Then, the transcripts associated with these similar videos are mined to extract keywords for the query. We conducted extensive experiments over the TRECVID 2005 corpus and showed the superiority of the proposed approach to using only the mining process on the original video for annotation. This work represents the first attempt at unsupervised automatic video annotation leveraging overlapping video content. Index Terms — video annotation, video search, data mining 1.
Semantic adaptation of sport videos with user%2Dcentred performance analysis.

View registration using interesting segments of planar trajectories.
We introduce a method for recovering the spatial and temporal alignment between two or more views of objects moving over a ground plane. Existing approaches either assume that the streams are globally synchronized, so that only solving the spatial alignment is needed, or that the temporal misalignment is small enough so that exhaustive search can be performed. In contrast, our approach can recover both the spatial and temporal alignment, regardless of their magnitude. We compute for each trajectory a number of interesting segments, and we use their description to form putative matches between trajectories. Each pair of corresponding interesting segments induces a temporal alignment, and defines an interval of common support across two views of an object that is used to recover the spatial alignment. Interesting segments and their descriptors are defined using algebraic projective invariants measured along the trajectories. Similarity between interesting segments is computed taking into account the statistics of such invariants. Candidate alignment parameters are verified checking the consistency, in terms of the symmetric transfer error, of all the putative pairs of corresponding interesting segments. Experiments are conducted with two different sets of data, one with two views of an outdoor scene featuring moving people and cars, and one with four views of a laboratory sequence featuring moving radio–controlled cars. 1
Low%2DCost 3D Scanning by Exploiting Virtual Image Symmetries.
Abstract — We present a low-cost, hybrid active/passive 3D scanning system based on an off-the-shelf camera, a laser stripe illuminator and a turntable. The system combines the good accuracy of active triangulation approaches with the flexibility of self-calibration based approaches. System operation is based on the construction of a single view of a virtual surface of revolution, from which camera calibration (both intrinsic and extrinsic parameters) is performed by exploiting the same object being scanned. Shape acquisition is finally obtained by laser profile reconstruction and collation. Experiments with both synthetic and real data are shown, providing an insight into both camera calibration and shape reconstruction performance. Index Terms — 3D scanners, camera calibration, shape reconstruction, projective symmetry I.
Content%2Dbased retrieval of 3D models through curvature maps a CBR approach exploiting media conversion.
Abstract In this introduction, we present a brief state of the art of multimedia indexing and retrieval as well as highlight some notions explored in the special issue. We hope that the contributions of this special issue will present ingredients for further investigations on this ever challenging domain. The special issue is actually situated between old problems and new challenges, and contribute to understand the next multimedia indexing and retrieval generation. The contributions explore wide range of fields such as signal processing, data mining and information retrieval.
Towards on%2Dline saccade planning for high%2Dresolution image sensing.

KDD%2FMDM 2006 The 7th KDD Multimedia Data Mining workshop report.

Content%2Dbased retrieval of 3D models.

Automatic video annotation using ontologies extended with visual information.

View registration using interesting segments of planar trajectories.
We introduce a method for recovering the spatial and temporal alignment between two or more views of objects moving over a ground plane. Existing approaches either assume that the streams are globally synchronized, so that only solving the spatial alignment is needed, or that the temporal misalignment is small enough so that exhaustive search can be performed. In contrast, our approach can recover both the spatial and temporal alignment, regardless of their magnitude. We compute for each trajectory a number of interesting segments, and we use their description to form putative matches between trajectories. Each pair of corresponding interesting segments induces a temporal alignment, and defines an interval of common support across two views of an object that is used to recover the spatial alignment. Interesting segments and their descriptors are defined using algebraic projective invariants measured along the trajectories. Similarity between interesting segments is computed taking into account the statistics of such invariants. Candidate alignment parameters are verified checking the consistency, in terms of the symmetric transfer error, of all the putative pairs of corresponding interesting segments. Experiments are conducted with two different sets of data, one with two views of an outdoor scene featuring moving people and cars, and one with four views of a laboratory sequence featuring moving radio–controlled cars. 1
Computer Vision Based System for Interactive Cooperation of Multiple Users.

Domain Knowledge Extension with Pictorially Enriched Ontologies.

Automatic Annotation of Sport Video Content.

An Invariant Representation for Matching Trajectories Across Uncalibrated Video Streams.

Soccer Videos Highlight Prediction and Annotation in Real Time.

3D Database Population from Single Views of Surfaces of Revolution.

Curvature Correlograms for Content Based Retrieval of 3D Objects.

3D Mesh Partitioning for Retrieval by Parts Applications.

Video Annotation with Pictorially Enriched Ontologies.
In this paper, we present the dynamic pictorial ontology paradigm for video annotation. Ontologies are often used to describe a given domain for different goals, including description of multimedia data. In the case of video annotation, the visual knowledge cannot be described using only abstract concepts but is more effectively represented in a visual form. To this aim, we introduce visual concepts, elicited from the data set as the most representative prototypes that specialize abstract concepts. The ontology created is intrinsically dynamic since it must embrace the perceptual and visual experience during annotation. Thus visual concepts can change, adapting to the multimedia content analyzed. Motivation for this new ontology paradigm are discussed together with a proposal of a framework for ontology creation, maintenance, and automatic annotation of video. The creation and usage of dynamic pictorial ontologies have been tested for soccer domain exploiting low level perceptual features and higher level domain features.
Segmentation of 3D Objects Using Pulse%2DCoupled Oscillator Networks.

Retrieval of 3D objects using curvature correlograms.

Player identification in soccer videos.
A method for the identification of players in soccer videos is presented. The proposed approach exploits the inherent multiple media structure of soccer videos to perform people identification without relying on face recognition. Instead, faces are detected in closeup shots, and then the filmed player is recognized by means of recognition of the number depicted on the frontal part of its jersey, or by detection and interpretation of superimposed closed caption. Players not identified by this process are then assigned to one of the labeled faces by means of a face similarity measure. We present results obtained from soccer videos of the last European Championship for national teams, held in Portugal in June 2004.
Enhanced ontologies for video annotation and retrieval.

Retrieval by content similarity of 3D Models using spin images.

Natural Interfaces to Enhance Visitors%27 Experiences.

Metric 3D Reconstruction and Texture Acquisition of Surfaces of Revolution from a Single Uncalibrated View.
Image analysis and computer vision can be effectively employed to recover the three-dimensional structure of imaged objects, together with their surface properties. In this paper, we address the problem of metric reconstruction and texture acquisition from a single uncalibrated view of a surface of revolution (SOR). Geometric constraints induced in the image by the symmetry properties of the SOR structure are exploited to perform self-calibration of a natural camera, 3D metric reconstruction and texture acquisition. By exploiting the analogy with the geometry of single axis motion, we demonstrate that the imaged apparent contour and the visible segments of two imaged cross sections in a single SOR view provide enough information for these tasks. Original contributions of the paper are: single view self-calibration and reconstruction based on planar rectification, previously developed for planar surfaces, has been extended to deal also with the SOR class of curved surfaces; self-calibration is obtained by estimating both camera focal length (1 parameter) and principal point (2 parameters) from three independent linear constraints for the SOR fixed entities; the invariant-based description of the SOR scaling function has been extended from affine to perspective projection. The solution proposed exploits both the geometric and topological properties of the transformation that relates the apparent contour to the SOR scaling function. Therefore, with this method a metric localization of the SOR occluded parts can be made, so as to cope with them correctly. For the reconstruction of textured SORs, texture acquisition is performed without requiring the estimation of external camera calibration parameters, but only using internal camera parameters obtained from...
Guest Editors%27 Introduction to the Special Section on Syntactic and Structural Pattern Recognition.

Guest Editorial Special Issue on Video Segmentation for Semantic Annotation and Transcoding.

An Integrated Framework for Semantic Annotation and Adaptation.

Common Visual Cues for Sports Highlights Modeling.

Content Based Retrieval of 3D Data.

A Graph Edit Distance Based on Node Merging.

Common visual cues for sports highlights detection.

Content%2Dbased video adaptation with user%27s preferences.

3D content%2Dbased retrieval with spin images.

Shape representation by spatial partitioning for content based retrieval applications.

Object%2DBased and Event%2DBased Semantic Video Adaptation.

Multiresolution Spatial Partitioning for Shape Representation.

Spin Images for Retrieval of 3D Objects by Local and Global Similarity.

Motion Capture Based on Color Error Maps in a Distributed Collaborative Environment.

Object%2DBased and Event%2DBased Semantic Video Adaptation.

Semantic video adaptation based on automatic annotation of sport videos.

Retrieval of 3D objects by visual similarity.

Merging Results for Distributed Content Based Image Retrieval.
Abstract. Searching information through the Internet often requires users to separately contact several digital libraries, use each library interface to author the query, analyze retrieval results and merge them with results returned by other libraries. Such a solution could be simplified by using a centralized server that acts as a gateway between the user and several distributed repositories: The centralized server receives the user query, forwards the user query to federated repositories—possibly translating the query in the specific format required by each repository—and fuses retrieved documents for presentation to the user. To accomplish these tasks efficiently, the centralized server should perform some major operations such as: resource selection, query transformation and data fusion. In this paper we report on some aspects of MIND, a system for managing distributed, heterogeneous multimedia libraries (MIND, 2001, http://www.mind-project.org). In particular, this paper focusses on the issue of fusing results returned by different image repositories. The proposed approach is based on normalization of matching scores assigned to retrieved images by individual libraries. Experimental results on a prototype system show the potential of the proposed approach with respect to traditional solutions.
Highlights modeling and detection in sports videos.

Collection Fusion for Distributed Image Retrieval.

Annotation and Retrieval of Structured Video Documents.

Retrieval of 3D objects using curvature maps and weighted walkthroughs.

Highlight extraction in soccer videos.

Automatic extraction and annotation of soccer video highlights.

Model checking for detection of sport highlights.

Merging Results for Distributed Content based Image Retrieval.
Abstract. Searching information through the Internet often requires users to separately contact several digital libraries, use each library interface to author the query, analyze retrieval results and merge them with results returned by other libraries. Such a solution could be simplified by using a centralized server that acts as a gateway between the user and several distributed repositories: The centralized server receives the user query, forwards the user query to federated repositories—possibly translating the query in the specific format required by each repository—and fuses retrieved documents for presentation to the user. To accomplish these tasks efficiently, the centralized server should perform some major operations such as: resource selection, query transformation and data fusion. In this paper we report on some aspects of MIND, a system for managing distributed, heterogeneous multimedia libraries (MIND, 2001, http://www.mind-project.org). In particular, this paper focusses on the issue of fusing results returned by different image repositories. The proposed approach is based on normalization of matching scores assigned to retrieved images by individual libraries. Experimental results on a prototype system show the potential of the proposed approach with respect to traditional solutions.
Automatic Interpretation of Soccer Video for Highlights Extraction and Annotation.

Semantic annotation for live and posterity logging of video documents.

Semantic annotation of soccer videos automatic highlights identification.
Automatic semantic annotation of video streams allows both to extract significant clips for production logging and to index video streams for posterity logging. Automatic annotation for production logging is particularly demanding, as it is applied to non-edited video streams and must rely only on visual information. Moreover, annotation must be computed in quasi realtime. In this paper, we present a system that performs automatic annotation of the principal highlights in soccer video, suited for both production and posterity logging. The knowledge of the soccer domain is encoded into a set of finite state machines, each of which models a specific highlight. Highlight detection exploits visual cues that are estimated from the video stream, and particularly, ball motion, the currently framed playfield zone, players# positions and colors of players# uniforms. The highlight models are checked against the current observations, using a model checking algorithm. The system has been developed within the EU ASSAVID project.
Weighted walkthroughs between extended entities for retrieval by spatial arrangement.

Visual capture and understanding of hand pointing actions in a 3%2DD environment.
We present a nonintrusive system based on computer vision for human-computer interaction in three--dimensional (3-D) environments controlled by hand pointing gestures. Users are allowed to walk around in a room and manipulate information displayed on its walls by using their own hands as pointing devices. Once captured and tracked in real-time using stereo vision, hand pointing gestures are remapped onto the current point of interest, thus reproducing in an advanced interaction scenario the &#034;drag and click&#034; behavior of traditional mice. The system, called PointAt (patent pending), enjoys a careful modeling of both user and optical subsystem, and visual algorithms for self-calibration and adaptation to both user peculiarities and environmental changes. The concluding sections provide an insight into system characteristics, performance, and relevance for real applications.
Uncalibrated 3 metric reconstruction and flattened texture acquisition from a single view of a surface of revolution.

Extraction of Resource Descriptors for Distributed Content Based Image Retrieval.

Semantic Annotation and Indexing of News and Sports Videos.

Semantic Annotation of Sports Videos.

Using 3D and Ancillary Media to Train Construction Workers.

Three%2DDimensional Interfaces for Querying by Example in Content%2DBased Image Retrieval.
Image databases are nowadays widely exploited in a number of different contexts, ranging from history of art, through  medicine, to education. Existing querying paradigms are based either on the usage of textual strings, for high-level semantic queries or  on 2D visual examples for the expression of perceptual queries. Semantic queries require manual annotation of the database images.
Introduction to the special issue on multimedia database.

Indexing for reuse of TV news shots.
demonstrating  interest  inbuilding digdin  archives of their assets for reuse of archive materials for TVprogC#x  or on-line availability. This requires tools for  videoindexing  and retrieval by content.
Spatial arrangement of color in retrieval by visual similarity.

3D Wavelet Based Video Retrieval.

A Vision%2DDriven Gesture%2DBased Pointer for Computer%2DAugmented Environments.

Real%2DTime Tracking and Reproduction of 3D Human Body Motion.

Advanced man%2Dmachine interface for cultural heritage.

Description and retrieval of 3D cellular structures.

Automatic Caption Localization in Videos Using Salient Points.

Classification Of Rawmaterial Sports Videos For Broadcasting Using Color And Edge Features.

Content Based Retrieval Of 3d Cellular Structures.

Content%2Dbased indexing and retrieval of TV news.

Spatial Arrangement Of Color Flows For Video Retrieval.

Semantic Characterization of Visual Content for Sports Videos Annotation.

Efficient Matching and Indexing of Graph Models in Content%2DBased Retrieval.

Retrieval of Commercials by Semantic Content The Semiotic Perspective.
Video information processing and retrieval is a key aspect of future multimedia technologies and applications. Commercial videos encode several planes of expression through a rich and dense use of colors, editing effects, viewpoints and rhythms, which are exploited together to attract potential purchasers. Databases of commercials can be accessed in order to analyze how a commercial has been developed, retrieve commercials similar to an example, catalog commercials according to the kind of message conveyed to the user. In this paper, we present a system allowing the retrieval of commercial streams based on their salient semantics. Semantics is regarded from the semiotics perspective: collections of signs and semantic features like colors, editing effects, motion, etc. are used as basic blocks with which the meaning of a commercial is constructed. In our system, it is possible to retrieve commercials according to both the meaning they convey and to their similarity to examples.
Modelling Spatial Relationships between Colour Clusters.

Content%2Dbased indexing and retrieval of TV news.

Video Retrieval Based on Dynamics of Color Flows.

Semantics%2DBased Retrieval by Content.

Video Retrieval Based on Dynamics of Color Flows.

Issues and Directions in Visual Information Retrieval.

Image Retrieval by Positive and Negative Examples.

The Computational Aspect of Retrieval by Spatial Arrangement.

Using Multiple Examples for Content%2DBased Image Retrieval.

Retrieval by Content of Commercials based on Dynamics of Color Flows.

Content Based Annotation and Retrieval of News Videos.

Expressive Semantics for Automatic Annotation and Retrieval of Video Streams.

A Look%2DAhead Strategy for Graph Matching in Retrieval by Spatial Arrangement.

A Mosaic%2DBased Query Language for Video Databases.

Guest Editor%27s Introduction Multimedia Computing and Systems.

Retrieval by Shape Similarity with Perceptual Distance and Effective Indexing.
An important problem in accessing and retrieving visual information is to provide efficient similarity matching in large databases. Though much work is being done on the investigation of suitable perceptual models and the automatic extraction of features, little attention is given to the combination of useful representations and similarity models with efficient index structures. In this paper
Virtual Reality for Image Retrieval.

Special Issue on Image Databases Visual Querying and Retrieval.

Retrieval of Commercials based on Dynamics of Color Flows.

Guest Editor%27s Introduction.

Efficient shape retrieval by parts.

Generalized Bounds for Time to Collision from First%2DOrder Image Motion.
This paper addresses the problem of estimating time to collision from local motion #eld measurements in the case of unconstrainedrelative rigid motion and surface orientation. It is #rst observed that, as long as time to collision is regardedasascaled depth, the above problem does not admit a solution unless a narrow camera #eld of view is assumed. By a careful generalization of the time to collision concept, it is then expounded how to compute novel solutions which hold however wide the #eld of view. The formulation, which reduces to known literature approaches in the narrow #eld of view case, extends the applicability range of time to collision basedtechniques in areas such as mobile robotics and visual surveillance. The experimental validation of the main theoretical results includes a comparison of narrow- and wide-#eld of view time to collision approaches using both dense and sparse motion estimates.
Managing the Complexity of Match in Retrieval by Spatial Arrangement.

The Photographer Metaphor for Content Based Image Retrieval.

Retrieval by Shape Using Multidimensional Indexing Structures.
In modern visual information retrieval systems, visual content is directly addressed by features such as color, texture, shape and spatial relationship. While a large work is being done around the perceptual soundness of models and around the automatic extraction of features, only a limited attention is placed on the combination of useful representations and similarity models with efficient index structures for shape. In this paper, we discuss retrieval by shape similarity using local features and metric indexing. Shape is partitioned into tokens in correspondence with its protrusions, following curvature analysis. Each token is modeled by a set of perceptually salient attributes, and two distinct distance functions are used to model token similarity and shape similarity. Shape indexing is obtained by arranging shape tokens into a M-tree index structure, suitably modified. Examples from a prototype system are expounded with considerations about the effectiveness of the approach and a comparative performance analysis.
Querying by Photographs Using Virtual Reality for Content%2DBased Image Retrieval.

Weighting Spatial Arrangement of Colors in Content Based Image Retrieval.

Video Retrieval using Semantic Data.

A Compact and Retrieval%2DOriented Video Representation Using Mosaics.

GUEST EDITORS%27 INTRODUCTION Content%2DBased Access of Image and Video Libraries.

Semantics in Visual Information Retrieval.
Current image indexing methods are based on measures of visual content. However, this approach provides only a partial solution to the image retrieval problem. For example, an artist might want to retrieve an image (for use in an advertising campaign) that evokes a particular &#034;feeling&#034; in the viewer. One technique for measuring evoked feelings, which originated in Japan, indexes images based on the inner impression (i.e. the kansei) experienced by a person while viewing an image or object -- impressions such as busy, elegant, romantic, or lavish. The aspects of the image that evoke this inner impression in the viewer are called kansei factors. The challenge in kansei research is to enumerate those factors, with the ultimate goal of indexing images with the &#034;inner impression&#034; that viewers experience. Thus, the focus is on the viewer, rather than on the image, and similarity measures derived from kansei indexing represent similarities in inner experience, rather than visual similarity. This paper presents the results of research that indexes images based on a set of kansei impressions, and then looks for correlations between that indexing and traditional content-based indexing. The goal is to allow the indexing of images based on the inner impressions they evoke, using visual content.
Shape indexing by multi%2Dscale representation.
Accessing large image databases requires effective indexing in order to restrict the number of database items that have to be processed. Indexing based on shapes is particularly challenging owing to the difficulty of deriving a similarity measure that supports clustering of shapes conforming with human perceptual similarity. Most previous techniques are based on the extraction of salient shape features and their organization into multi-dimensional point access structures. However, these features are extracted by analyzing shapes at a single resolution scale, and are not able to provide a robust representation. In this paper, we present a technique which exploits multi-scale analysis of shapes, to derive a hierarchical shape representation in which shape details are progressively filtered out while shape characterizing elements are preserved. A graph structure is introduced to represent shape parts at different scales and a procedure is defined to merge graphs of different shapes. Given a query shape, the graph can be traversed to select, through a coarse to fine matching, those database shapes which share similar structural parts with the query. # 1999 Elsevier Science B.V. All rights reserved.
A Visual Formalism for Computational Tree Logic.

Image Retrieval by Color Semantics.

Color%2Dinduced image representation and retrieval.
In this paper, we describe a framework for pictorial content representation, query formulation and image retrieval based on color distributions. Image content is described through a set of color histograms, each relative to a region with a homogeneous color distribution. The representation also includes geometric features induced by the color distribution based segmentation process. A metric of similarity between images using the above representation and generalizing the histogram intersection operator is de&#034;ned, allowing to perform retrieval by color distribution content. User query images are interactively created and modi&#034;ed through a graphic environment featuring color sketching, image examples and relevance feedback. The user is also provided with two novel query composition and re&#034;nement tools, based respectively on an internal query memory and on a direct manipulation of internal query representation. Examples of operation are provided, and experimental results are reported indicating that, thanks to the superiority of multiple distributions over global color histogramming, the quality of image retrieval is in good accordance with human expectation. # 1999 Pattern Recognition Society. Published by Elsevier Science Ltd. All rights reserved.
Real%2Dtime head tracking from the deformation of eye contours using a piecewise affine camera.

Retrieval of Paintings Using Effects Induced by Color Features.

Commercial Video Retrieval by Induced Semantics.

Retrieval of Commercials by Video Semantics.

Computer Analysis of TV Spots The Semiotics Perspective.

Interactive Image Retrieval by Color Distributions.

Embodying Semiotic Cues in Video Retrieval.

Virtual Reality for Image Retrieval.

Weighting Spatial Relationships in Retrieval by Visual Contents.

3D Navigation of Geographic Data Sets.

Query by dialog an interactive approach to pictorial querying.

Image Retrieval by Color Semantics with Incomplete Knowledge.

Structured representation and automatic indexing of movie information content.

Visual Querying By Color Perceptive Regions.
A major research subject in image databases is to support e#cient and e#ective access to images  based on their visual content. In color image databases, this requires to support image retrieval by both  global and local chromatic features. Image retrieval by color regions is complicated by the fact that regions  which are requested in the query should correspond to relevant colored regions in the retrieved images. In  the following we present the PICASSO system, which supports image indexing and retrieval based on  colors. The system exploits a pyramidal representation of images. Multiple descriptions of image properties  are created at di#erent levels of resolution thus allowing e#ective retrieval through specific queries as well as  imprecise ones. # 1998 Pattern Recognition Society. Published by Elsevier Science Ltd. All rights reserved  Image databases Color image retrieval Multi-resolution analysis  1. 
Image Analysis and Processing
* Information from on-line imaging sensors has great potential for the monitoring and control of quality in spatially distributed systems. The major difficulty lies in the efficient extraction of information from the images, information such as the frequencies of occurrence of specific and often subtle features, and their locations in the product or process space. This paper presents an overview of multivariate image analysis methods based on Principal Component Analysis and Partial Least Squares for decomposing the highly correlated data present in multi-spectral images. The frequencies of occurrence of certain features in the image, regardless of their spatial locations, can be easily monitored in the space of the principal components. The spatial locations of these features can then be obtained by transposing highlighted pixels from the PC score space into the original image space. In this manner it is possible to easily detect and locate even very subtle features from online imaging sensors for the purpose of statistical process control or feedback control of spatial processes. The concepts and potential of the approach are illustrated using a sequence of LANDSAT satellite multispectral images, depicting a pass over a certain region of the earth’s surface. Potential applications in industrial process monitoring using these methods will be discussed from a variety of areas such as pulp and paper sheet products, lumber and polymer films.
Image Analysis and Processing
* Information from on-line imaging sensors has great potential for the monitoring and control of quality in spatially distributed systems. The major difficulty lies in the efficient extraction of information from the images, information such as the frequencies of occurrence of specific and often subtle features, and their locations in the product or process space. This paper presents an overview of multivariate image analysis methods based on Principal Component Analysis and Partial Least Squares for decomposing the highly correlated data present in multi-spectral images. The frequencies of occurrence of certain features in the image, regardless of their spatial locations, can be easily monitored in the space of the principal components. The spatial locations of these features can then be obtained by transposing highlighted pixels from the PC score space into the original image space. In this manner it is possible to easily detect and locate even very subtle features from online imaging sensors for the purpose of statistical process control or feedback control of spatial processes. The concepts and potential of the approach are illustrated using a sequence of LANDSAT satellite multispectral images, depicting a pass over a certain region of the earth’s surface. Potential applications in industrial process monitoring using these methods will be discussed from a variety of areas such as pulp and paper sheet products, lumber and polymer films.
Image Retrieval by Color Regions.
A major research subject in image databases is to support e#cient and e#ective access to images  based on their visual content. In color image databases, this requires to support image retrieval by both  global and local chromatic features. Image retrieval by color regions is complicated by the fact that regions  which are requested in the query should correspond to relevant colored regions in the retrieved images. In  the following we present the PICASSO system, which supports image indexing and retrieval based on  colors. The system exploits a pyramidal representation of images. Multiple descriptions of image properties  are created at di#erent levels of resolution thus allowing e#ective retrieval through specific queries as well as  imprecise ones. # 1998 Pattern Recognition Society. Published by Elsevier Science Ltd. All rights reserved  Image databases Color image retrieval Multi-resolution analysis  1. 
Sensations and Psychological Effects in Color Image Database.

Shape Indexing by Structural Properties.

Pyramidal Retrieval by Color Perceptive Regions.

Visual Image Retrieval by Elastic Matching of User Sketches.
Effective image retrieval by content from database requires that visual image properties are used instead of textual  labels to properly index and recover pictorial data. Retrieval by shape similarity, given a user-sketched template is particularly  challenging, owing to the difficulty to derive a similarity measure that closely conforms to the common perception of similarity by  humans. In this paper, we present a technique which is based on elastic matching of sketched templates over the shapes in the  images to evaluate similarity ranks. The degree of matching achieved and the elastic deformation energy spent by the sketch to  achieve such a match are used to derive a measure of similarity between the sketch and the images in the database and to rank  images to be displayed. The elastic matching is integrated with arrangements to provide scale invariance and take into account  spatial relationships between objects in multi-object queries. Examples from a prototype system are expounded with considerations  about the effectiveness of the approach and comparative performance analysis.
Interacting through eyes.
With the growth in interactive network games comes an increased importance in a better understanding of the effects of latency on user performance. While previous work has studied the tolerance game players have for high latencies and has studied the effects of latency on user performance in real-time strategy games, to the best of our knowledge, there has been no systematic study of the effects of loss and latency on user performance. In this paper we study user performance for Unreal Tournament 2003 (UT2003), a popular FPS game, under varying amounts of latency and packet loss. First, we deduced typical real world values of packet loss and latency experienced on the Internet today by monitoring operational UT2003 game servers. We used these realistic values of loss and latency in a controlled networked environment that emulated various conditions of loss and latency, allowing us to test UT2003 at the network, application and user levels. We designed player actions down into the fundamental FPS interaction components of movement and shooting, and conducted numerous user studies under controlled network conditions. We find that levels of packet loss and latency typical for most UT2003 Internet server, while unpleasant, will not drastically impact player performance. Since most FPS games typically consist of the similar generic player actions to those that we tested, we believe that these results may have broader implications.
Image query by semantical color content.

Image Retrieval by Elastic Matching of Shapes and Image Patterns.

Querying and Retrieving Pictorial Data Using Semantics Induced by Colour Quality and Arrangement.

A Visual Language for Color%2DBased Painting Retrieval.

Visual Programming of Virtual Worlds Animation.

Optical flow computation using extended constraints.

A vision%2Dbased 3%2DD mouse.

Image and Video Databases Visual Browsing%2C Querying and Retrieval.

Multi%2DPerspective Navigation of Movies.

3D object classification using multi%2Dobject Kohonen networks.

Combining Head Tracking and Pupil Monitoring in Vision%2DBased Human%2DComputer Interaction.

Film Editing Reconstruction and Semantic Analysis.

Automatic Video Segmentation Through Editing Analysis.

Image Retrieval by Elastic Matching of User Sketches.
Effective image retrieval by content from database requires that visual image properties are used instead of textual  labels to properly index and recover pictorial data. Retrieval by shape similarity, given a user-sketched template is particularly  challenging, owing to the difficulty to derive a similarity measure that closely conforms to the common perception of similarity by  humans. In this paper, we present a technique which is based on elastic matching of sketched templates over the shapes in the  images to evaluate similarity ranks. The degree of matching achieved and the elastic deformation energy spent by the sketch to  achieve such a match are used to derive a measure of similarity between the sketch and the images in the database and to rank  images to be displayed. The elastic matching is integrated with arrangements to provide scale invariance and take into account  spatial relationships between objects in multi-object queries. Examples from a prototype system are expounded with considerations  about the effectiveness of the approach and comparative performance analysis.
Symbolic Indexing of Cardiological Sequences Through Dynamic Curve Representations.

Iconic Retrievial by Contents from Databases of Cardiological Sequences.

Navigation and Visualization of Movies Content.

Visual Specification of Branching Time Temporal Logic.

A Robust Algorithm for Optical Flow Estimation.

Symbolic Description and Visual Querying of Image Sequences Using Spatio%2DTemporal Logic.

Specification by%2DExample of Virtual Agents Behavior.

Analysis of optical flow constraints.

Block%2Dstructured recurrent neural networks.
This paper introduces a new class of dynamic multi layer perceptrons, called  Block Feedback Neural Networks (B F N). B F N have been developed to provide a systematic way to build networks of high complexity, including networks with coupled loops, nested loops and so on. B F Ns are specified using a block notation. Any B F N can be seen as a block and connected to other B F Ns using a fixed number of  elementary connections. The result of such a connection can also be considered as a block, and connected to other blocks, in a recursive fashion. We develop a cost-minimizing supervised training algorithm for this model. The algorithm is a gradient-descent type, and is tailored on the block structure of the model. Finally, we present some experiments of use of B F Ns. 1 Introduction  The interest in dynamic neural networks has been steadily growing in the past few years, and a number of models have been proposed -- such as Williams and Zipser&#039;s Forward Propagation network (Williams and Z...
Recurrent neural networks can be trained to be maximum a posteriori probability classifiers.
This paper proves that supervised learning algorithms used to train recurrent neural networks have an equilibrium point when the network implements a Maximum A Posteriori Probability (MAP) classifier. The result holds as a limit when the size of the training set goes to infinity. The result is general, since it stems as a property of cost minimizing algorithms, but to prove it we implicitly assume that the network we are training has enough computing power to actually implement the MAP classifier. This assumption can be satisfied using a universal dynamic system approximator. We refer our discussion to Block Feedback Neural Networks (B F Ns) and show that they actually have the universal approximation property. 1 Introduction  In this paper we prove that cost minimizing learning algorithms used to train dynamic neural networks have an equilibrium point when the network implements a multi-step Maximum Aposteriori Probability (MAP) classifier. The result holds for a large class of cost f...
Properties of block feedback neural networks.

Optical flow by nonlinear relaxation.

Interactive Training of Virtual Agents.

An Interactive Environement for the Visual Programming of Virtual Agents.

Visual Image Retrieval by Elastic Deformation of Object Sketches.

Performance Analysis of Two Different Algorithms for Ethernet%2DFDDI Interconnection.

A Spatial Logic for Symbolic Description of Image Contents.

Optical flow through relaxation in the velocity space.

Visual Specification of Virtual Worlds.

Panel Visual Database Systems.

Sequence Retrieval by Contents through Spatio Temporal Indexing.

A Three%2DDimensional Iconic Environment for Image Database Querying.
Computer vision offers a number of techniques that can be used in the context of pictorial information systems. To motivate this point of view, we first present the basic issues involved in computer vision and in multimedia information systems, and emphasize the differences between these domains. We then outline the contributions that computer vision can make to the development of efficient multimedia information systems, especially for handling queries by visual example (QVE). In the second part of the paper, we concentrate on the matters of archiving and retrieving images from large databases, in the case of QVE. An approach is proposed that relies on two concepts, namely relevance and focusof -attention. These mechanisms allow to locate and select the most pertinent information from images. They can be used at the image archival stage, to automatically determine which parts of the image should provide meaningful indices to be compiled into the image access tables. Relevance and focu...
An Iconic Environment for Image%2Dprocessing Operations.

Optical flow from constraint lines parametrization.

A programming environment for imaging applications.

A 3D Visual Environment for Querying Image Databases.

Estimation and Interpretation of Optical Flow Fields for Counting Moving Objects.
The main goal of sequence analysis is the motion estimation of moving objects which are present in the scene. One of the most important approaches for motion estimation is based on the estimation of an approximated projection of 3D motion on the image plane, which is usually called optical flow. The collection in time of these optical flows can be useful to understand the object structure and behavior. In this paper, the problem of counting people by interpreting optical flow fields in space and time is presented. Experimental results of counting people who are going inlout of a public bus are reported. 1
Using 3D Spatial Relationships for Image Retrieval by Contents.

A Spatio%2Dtemporal Logic for Image Sequence Coding and Retrieval.

Interprocess Communication Dependency on Network Load.

Object Motion Identification for Object Recognition.
Motion analysis has been used for a long time in vision to derive the 3-D shape of the moving object from the image sequence as well as to derive the motion law for prediction and tracking. However, motion can also be regarded as a property of the object and hence employed for improving recognition. This is particularly useful when the form ~rovides little or no hel ~ in discriminatine between different hypotheses. In this paper, an approach isiresented in which motion descriptors are defined at different levels of abstraction. Coarse descriptors refer to the motion of rigid objects. Finer descriptors model the motion of compoiite objects with coordinated moving subparts. Autoregressive models are used to provide motion descriptor estimations. 1.
Object decomposition and subpart identification %2D classification algorithms.

